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1 Aims of the 2013 survey of expert opinion on 
intelligence 


1. Replication of the 30 year old study from Snyderman and 
Rothman in the 1980s (collected 1984; published 1987 & 1988). 
Confirmation ? 

Is there any change in opinions among experts? 

2. Update of questions: 

Inclusion of in the last decades developed research agendas: 
FLynn effect, 

student assessment studies, 
international differences. 
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Purpose 


1. What do experts think? 

To know what is the mean/median/mode/majority opinion on 
important and frequently hotly disputed research topics. 

2. Increase epistemic rationality in the media and public. 

To counter a tradition in the media and sometimes in research of 
citing unknown, marginal, or questionable studies or researchers 
as the experts for research on intelligence 
(“Gould-Harvard-effect” or the “Double G-Harvard-effect”). 

We present the mean/median/mode/majority expert opinion. 

3. Come closer to truth. 

To have an indirect (majority based) indicator for truth. 
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Two problems 

1. We need an unbiased selection of experts. 

(From emails: Both “lefties” and “righties” rejected to 

participate in our survey because 

questions were not good, 

expert selection would not be good or 

truth could not be found by majority decisions.) 

We do not need all experts, but an unbiased sample. 

2. One empirical study (and logic) can overrule any majority opinion. 
However, in a (partially) open society with (partially) free debate 
and (partially) rational approach to epistemic-scientific questions 
the majority opinion of experts, based on individual judgements, 
is at least one indicator for truth. 

-> Galton (1907): Vox populi (average of different judges) in 

estimating the weight of a “fat ox” was correct within 1 per cent 
of the real value. 
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2 Method 


Experts 

1 . Authors of papers published in 

• Intelligence 

• Cognitive Psychology 

• Biological Psychology (if article addressed intelligence or a 
related topic) 

• Journal of Mathematical Psychology (i a i) 

• Contemporary Educational Psychology!} a i) 

• Journal of School-Psychology (i a i) 

• New Ideas in Psychology (i a i) 

• Journal of Applied Developmental Psychology!} a i) 
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2. For the subject well known scientists or journalists writing on it. 

3. Scientists emailed by ISIR member list 
(thanks to ISIR and David Lubinski!). 

4. Scientists informed by ISSID website (thanks to ISSID, 

Don Saklofske & Michael Houlihan). 

5. Scientists and interested students (/V st ^3) informed by colleagues. 

Participation only after invitation 

(to prevent any seizing by interest groups). 

Web based survey 

• Questionnaire with 62 main questions. 

• LimeSurvey. 

• Anonymous. We only know who has never reacted and who has 
ever reacted, but we cannot identify persons: how many questions 
a person has answered and what a person has answered. 
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Snyderman and Rothman (1984) 

Us (R, C& B, 2013) 

49 questions 

62 questions 

1020 questionnaires 

emailed to 1237 persons 

661 (65 %) participants 

228 (18 %) participants 
(70 completed + 158 partially) 

1984 

Spring and summer 2013 


[Are there so many experts for intelligence research?] 
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3 Major results 


Terms and attributes 

Difference between 
“cognitive ability” and 
“cognitive competence”? 



■ Yes 

■ No 
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Difference between 
“cognitive ability” and 
“intelligence”? 


45,8 

% 


54,2 

% 


■ Yes 

■ No 
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Important elements of “intelligence” and “cognitive ability” 

(compared to Snyderman & Rothman, order according to relevance) 


Reasoning 


Abstract 

thinking 

Problem solving 
ability 


Applying logic 

Understanding, 

Comprehension 

123456789 



■ Intelligence 

■ Cognitive ability 
□ S & R (1984) 
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Capacity to aquire knowledge 
Conzept form., categor. 

Working Memory 
Learning 
Verb, ability / knowledge 
Math, ability / knowledge 

123456789 



■ Intelligence 

■ Cognitive ability 
□ S & R (1984) 
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The use of 
knowledge 

Spatial ability 

Mental Speed 

Adaption to one's 
environment 

Science 

ability/knowledge 
Memory 

123456789 



■ Intelligence 

■ Cognitive ability 
□ S & R (1984) 
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Rationality 


Creativity 

Knowledge 

Sensory acuity 

Personality as achivement 
motivation 
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■ Intelligence 

■ Cognitive ability 
□ S & R (1984) 


4 5 6 7 8 9 
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Heredity and environment 

Sources of reasonable evidence for a significant nonzero heritability of 
cognitive ability/intelligence. 

Studies of MZT rear. ap. 

Comparisons of MZT to DZT 

Adoption studies 

Kinship correl. among 
relatives 

Molecular genetic studies 
Patchwork family studies 

0 25 50 75 100 



■ R, C & B (2013) 

□ S 8i R (1984) 
[white pop.] 
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Sufficient evidence to arrive at a reasonable estimate of the 
heritability of cognitive ability/intelligence in populations of 
developed countries? 



■ Yes 

■ No 

□ Other 
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Sources of U.S. black-white differences in IQ 


Snyderman & Rothman 
(1984) 


24,0 

% 



(74% of experts 
having an opinion) 


■ Environ. ■ Genetic 

□ Both □ Insuff. data 

□ No answer 


0% 

of differences due to genes: 

(17% of our experts) 

0-40% 

of differences due to genes: 

42% of our experts 

50% 

of differences due to genes: 

18% of our experts 

60-100% 

of differences due to genes: 

39% of our experts 

100% 

of differences due to genes: 

(5% of our experts) 

Ai=47% 

of differences due to genes (SD=31%) 
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Intelligence effects 

Influence of average cognitive ability level and highly cognitive 
competent persons on positive development of... 


...society in general 
...economic growth and wealth 
...scientific development 
...technological development 
...political development 
...status of democracy 
...cultural development 



■ Average level 
□ High c.c.p. 


1 5 9 
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Measurement 

Bias? 


(1 = Insignificant bias; 


Test taker motivation 


Test taker anxiety 


Attitude of the examiner toward 
the group in question 

Language or dialect of the 
examiner 


Race/Ethnicity of the examiner 







1 5 
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9 = Large bias) 


■ R, C & B (2013) 
□ S & R (1984) 
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Racial/ethnic content bias in cognitive ability/intelligence tests? 
(1 = Insignificant amount; 4 = Large amount) 



□ R, C & B (2013) 
■ S & R (1984) 
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Bias against groups (1 = Insignificant bias; 9 = Large bias)? 


Immigrants 


Lower SES- 
groups 


Africans in 
Western world 



■ R, C & B (2013) 
□ S & R (1984) 


1 


5 


9 
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Separate test norms for different subgroups? 


Poorer and richer groups (generally) 
Natives and immigrants (generally) 
Social groups (generally) 


Ethnic groups (generally) 

White, Blacks, Hispanics, Jews, East- 
Asian (USA) 

White and Blacks (USA) 



■ Yes 

■ No 


0% 50% 100% 
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Media and public 


Accuracy of news sources relating intelligence testing 

(1 = Very inaccurate; 9 = Very accurate) 


Steve Sailer Blog 
Anatoly Karlin Blog 
Die Zeit 
FAZ 
Die Welt 
NZZ 
Times 
SZ 

Wallstreet Journal 



■ R, C & B (2013) 
□ S & R (1984) 


1 


9 
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Economist 1 
New York Times - 
Le Monde - 
Focus - 
Guardian - 
Der Spiegel - 
El Pais 1 
Time - 

National Public Radio - 

1 
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Washington Post 
Le Figaro 
taz 

Daily Telegraph 
Newsweek 
El Mundo 
State-owned TV-netw. 
Comm. TV-netw. 

1 
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Public debates: More science or ideology? 



Science Ideology 
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Secular rise (FLynn effect) 

Most plausible scientific theories about FLynn-Effect 

(1 = Not important; 9 = Important) 


Longer and freer edu. 
Better health 
Better nutrition 
Better edu. and schools 

Wealth 

Better edu. in families 
Better edu. of parents 
More intell. soc. envir. 



1 


9 
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More test-experience 
Computers etc. 
Smaller families 
TV and media 
Decline of group-inequ. 

Immigration 
Genetic changes 


1 
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Most plausible scientific theories about possible 
retrograde of FLynn-Effect (1 = Not important; 9 = Important) 


Fertility (genetic) 


Fertility (social) 

Deck in educ. 
values 

Worse edu. in 
schools 

Migration 




1 5 





TV and media 



Worse edu. in 
families 







Worse nutrition 






Worse health 







9 15 9 
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Increase or decrease of IQ points in regions up to 2100 


East Asia 
India 
Africa 
Latin America 
Arab.-Musi. World 
Eastern Euro. 
Australia 
Canada 
Israel 
Scandinavia 
West-Middle Euro. 
Western (general) 
Southern Euro. 

USA 




o 


1 2 3 4 5 6 7 
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International differences 

Most important factors for international cognitive ability differences: 

Education-sum: 20.6 % (quantity: 9.8%, quality: 11.0%) 

Genes: 15.3% 

See poster. 
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4 Missing, to improve 


Questions on social intelligence/competence 
Questions on emotional intelligence/competence 
Questions on successful intelligence/competence 
Questions on further multiple intelligences 

Among media and blogs: James Thompson’s bios 
(Psychological comments, http://drjamesthompson.blogspot.de) 

Participation rate of experts + further experts 

Subgroupanalyses. 
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